What can (partition) logic contribute to information theory?

نویسنده

  • David Ellerman
چکیده

Logical probability theory was developed as a quantitative measure based on Boole’s logic of subsets. But information theory was developed into a mature theory by Claude Shannon with no such connection to logic. But a recent development in logic changes this situation. In category theory, the notion of a subset is dual to the notion of a quotient set or partition, and recently the logic of partitions has been developed in a parallel relationship to the Boolean logic of subsets (subset logic is usually mis-specified as the special case of propositional logic). What then is the quantitative measure based on partition logic in the same sense that logical probability theory is based on subset logic? It is a measure of information that is named ”logical entropy” in view of that logical basis. This paper develops the notion of logical entropy and the basic notions of the resulting logical information theory. Then an extensive comparison is made with the corresponding notions based on Shannon entropy.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

An introduction to partition logic

Classical logic is usually interpreted as the logic of propositions. But from Boole’s original development up to modern categorical logic, there has always been the alternative interpretation of classical logic as the logic of subsets of any given (non-empty) universe set. Partitions on a universe set are dual to subsets of a universe set in the sense of the reverse-the-arrows category-theoreti...

متن کامل

The socio - cognitive theory in information retrieval (IR)

Abstract Background and Aim: The socio-cognitive theory introduced in information science by Horland and Alberchtsen. The socio-cognitive view turns the traditional cognitive program upside down. The socio-cognitive theory emphasizes on different cultural and social structures of users. Hence, the aim of the article is to explain the role of socio - cognitive theory in information retrieval (I...

متن کامل

Questions and Answers in an Orthoalgebraic Approach

Taking the lead from orthodox quantum theory, I will introduce a handy generalization of the Boolean approach to propositions and questions: the ortho-algebraic framework. I will demonstrate that this formalism relates to a formal theory of questions (or ‘observables’ in the physicist’s jargon). This theory allows to formulate conditioned questions such as “if electron 1 has spin ↑ what is the ...

متن کامل

Information as Distinctions: New Foundations for Information Theory

The logical basis for information theory is the newly developed logic of partitions that is dual to the usual Boolean logic of subsets. The key concept is a "distinction" of a partition, an ordered pair of elements in distinct blocks of the partition. The logical concept of entropy based on partition logic is the normalized counting measure of the set of distinctions of a partition on a finite ...

متن کامل

The Objective Indefiniteness Interpretation of Quantum Mechanics

The common-sense view of reality is expressed logically in Boolean subset logic (each element is either definitely in or not in a subset, i.e., either definitely has or does not have a property). But quantum mechanics does not agree with this "properties all the way down" picture of microreality. Are there other coherent alternative views of reality? A logic of partitions, dual to the Boolean l...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016